Method and apparatus for controlling electronic device using user interaction

ABSTRACT

A method and an apparatus for controlling an electronic device according to a user interaction occurring in a space neighboring the electronic device. The method for controlling an electronic device using an input interaction includes: recognizing at least one interaction occurring in a space neighboring the electronic device; and controlling the electronic device corresponding to the at least one interaction.

CLAIM OF PRIORITY

This application claims the benefit of priority under 35 U.S.C. §119from Korean Patent Application No. 10-2009-0068248 filed in the KoreanIntellectual Property Office on Jul. 27, 2009, the entire contents ofwhich are incorporated herein by reference.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to a method and a device for controllingan electronic device by a user motion. More particularly, the presentinvention relates to a method and an apparatus for controlling anelectronic device according to a user motion that is sensed by theelectronic device.

2. Description of the Related Art

In recent years, with the rapid development of communication technology,the functions of an electronic device, particularly a portableelectronic device have been gradually extended. Accordingly, varioususer interfaces and various functions for using them have been providedby manufacturers and service providers. Furthermore, various manners ofinput data and commands have been provided to control various functionsof the electronic device.

In order to control a corresponding electronic device within a generalelectronic device, namely, to perform various functions typicallyprovided by modules in the corresponding electronic device, control canbe made through key inputs with respect to keys included in theelectronic device. Otherwise, in the case of an electronic device havinga touch screen, such electronic devices can be controlled by a touchinput in a specific area of the touch screen. As described above, in therelated art, a direct input occurs in a specific input unit with thepurpose of controlling the electronic device.

However, as previously discussed, in the general electronic device thereare respective functions provided from a corresponding device that arecontrolled by a simple key input or touch input. Consequently, there isa limitation on a quantity of respective functions of the electronicdevice that they can be controlled by only the key input or touch input.Moreover, the respective functions have simplicity in that they arecontrolled in a unique input manner, such as a key input or a touchinput. In addition, conventionally, input units for controlling oneelectronic device cannot combine simultaneous inputs of different typesof input devices to support a function outputting corresponding results.

SUMMARY OF THE INVENTION

The present invention has been made to provide a method and an apparatusfor controlling an electronic device using a user interaction.

The present invention also provides a method and an apparatus that maycontrol an electronic device by a user interaction in an adjacent spaceneighboring the electronic device.

The present invention also provides a method and an apparatus that maycontrol an electronic device by a complex user interaction input from anadjacent space neighboring the electronic device.

The present invention also provides a method and an apparatus that mayrecognize at least one interaction occurring in an adjacent spaceneighboring an electronic device to control the electronic deviceaccording to the at least one recognized interaction.

The present invention also provides a multi-modal interface that may usevarious functions provided from an electronic device easily andintuitively.

The present invention also provides a method and an apparatus that mayrecognize at least one of a plane interaction and a space interaction ina space neighboring an electronic device to control the electronicdevice simply and intuitively according to the at least one recognizedinteraction.

In accordance with an exemplary aspect of the present invention, anelectronic device using an input interaction includes:

a device for recognizing at least one interaction occurring in a spaceneighboring with a predetermined distance of the electronic device; anda control unit for controlling the electronic device according to the atleast one interaction recognized by the device.

In accordance with another exemplary aspect of the present invention, anelectronic device control system includes:

a first device recognizing a plane interaction according to a usergesture operating on a plane around the electronic device; a seconddevice recognizing a space interaction according to a user gestureoperating in a space around the electronic device; and a processing unitthat discriminates between a plane interaction or a space interaction,and controls the electronic device corresponding to the discriminatedinteraction.

BRIEF DESCRIPTION OF THE DRAWINGS

The following exemplary objects, features and advantages of thepresently claimed invention will become more apparent from the followingdetailed description in conjunction with the accompanying drawings, inwhich:

FIGS. 1 to 3 are perspective views illustrating examples of anelectronic device in accordance with an exemplary embodiment of thepresent invention, respectively;

FIG. 4 is a perspective view schematically illustrating an electronicdevice in accordance with an exemplary embodiment of the presentinvention;

FIG. 5 is a diagram illustrating recognition areas of a recognizingplane and space interactions in an electronic device in accordance withan exemplary embodiment of the present invention;

FIGS. 6 to 8 are schematic diagrams illustrating an operating method ofan electronic device in respective recognition areas according to a usergesture in accordance with an exemplary embodiment of the presentinvention;

FIG. 9 is a flowchart illustrating an exemplary operation of a methodfor controlling an electronic device using a user interaction in anelectronic device in accordance with an exemplary embodiment of thepresent invention;

FIG. 10 is a flow diagram illustrating an overall operation forcontrolling an electronic device according to a user interaction inaccordance with an exemplary embodiment of the present invention;

FIGS. 11 to 14 are views illustrating exemplary embodiments of anoperation processing a function corresponding to a user interaction inan electronic device in accordance with an embodiment of the presentinvention;

FIGS. 15 and 16 are views illustrating another exemplary embodiment ofan operation processing a function corresponding to a user interactionin an electronic device in accordance with an exemplary embodiment ofthe present invention; and

FIGS. 17 to 20 are views illustrating further exemplary embodiments ofan operation processing a function corresponding to a user interactionin an electronic device in accordance with an exemplary embodiment ofthe present invention.

DETAILED DESCRIPTION

Hereinafter, exemplary embodiments of the present invention aredescribed in detail with reference to the accompanying drawings. Thesame reference numbers are used throughout the drawings to refer to thesame or like parts. Detailed descriptions of well-known functions andstructures incorporated herein may be omitted to avoid obscuringappreciation of the subject matter of the present invention by a personof ordinary skill in the art.

The present invention relates to a method and an apparatus forcontrolling an electronic device utilizing a user interaction. Theelectronic device according to an exemplary embodiment of the presentinvention includes at least one device recognizing at least oneinteraction occurring in an adjacent space neighboring the electronicdevice. Further, an exemplary embodiment of the present invention maycontrol functions of the electronic device according to the at least oneinteraction recognized by the at least one device.

In another exemplary embodiment of the present invention, the electronicdevice can identify, with a discrimination between them, a planeinteraction according to a user gesture occurring on a plane around theelectronic device, a space interaction according to a user gestureoccurring in a space around the electronic device, and a convergenceinteraction including both the plane interaction and the spaceinteraction. The electronic device processes and provides a functionaccording to a corresponding interaction.

The present invention preferably senses a user gesture (e.g., handshape, hand motion, moving direction of a hand, etc.) using a deviceincluded in the electronic device, and discriminates the sensed usergesture according to a preset definition to be uses as a meaningfulinput of the electronic device. Further, an exemplary embodiment of thepresent invention uses at least one device to sense and discriminate theuser gesture, and a discriminated input is defined to be used for acontrol interaction of the electronic device.

Hereinafter, an electronic device using a user interaction, a method anda device for controlling the electronic device using the userinteraction will be described. However, since an electronic device and acontrol operation thereof according to the present invention are notlimited to the following description, it will be recognized that theclaimed invention is applicable to various exemplary embodiments basedat least in part on the following embodiments.

FIGS. 1 to 3 are perspective views illustrating examples of anelectronic device in accordance with an exemplary embodiment of thepresent invention, respectively.

Referring now to FIGS. 1 to 3, FIG. 1 shows an example of a portableterminal that is one of the electronic devices utilized in the presentinvention. FIG. 2 shows an example of a guide system, which comprisesone of the electronic devices utilized in the present invention. FIG. 3shows an example of a television set which is one of electronic devicesused in the present invention.

In this particular case, the portable terminal of FIG. 1 may include allkinds of information and communication devices and multimedia devices,and application devices thereof, including but in no way limited to, forexample, a Portable Multimedia Player (PMP), a digital broadcastingplayer, a Personal Digital Assistant (PDA), a music player (e.g., MP3player), a portable game terminal and Smart Phone, as well as all kindsof mobile communication terminals operating based on communicationprotocols corresponding to various communication systems. Meanwhile, theexemplary guide system of FIG. 2 provides various guide informationrequested from a user in museums, exhibit halls, amusement parks, orstreets, and may include a screen monitor and a media pole fixed to awall, a column, or a ground. Furthermore, the exemplary television ofFIG. 3 indicates an example of a large electronic device, and mayfurther include a personal computer, a monitor of the personal computer,a notebook computer, or a monitor of the notebook computer, netbookcomputer, lap top computer, tablet computer, etc.

Referring now to FIGS. 1 to 3, the electronic device according to anexemplary embodiment of the present invention is a tool for providing anoutput corresponding to a user's input, and may include all types ofmiddle and largesized devices fixed to a specific space, as well assmall devices that a user can carry (portable). Accordingly,hereinafter, although the electronic device in the examples comprises aportable terminal as a representative example, a person of ordinaryskill in the art should understand and appreciate that the claimedinvention is in no way limited to a portable terminal, and can includeall devices in some of the various forms as mentioned above and others.

The electronic device according to an exemplary embodiment of thepresent invention senses at least one user interaction occurring in aspace neighboring the electronic device, and processes a functioncontrol according the user interaction. To do this, the electronicdevice of the present invention includes at least one sensing devicereceiving input of the at least one user interaction. Hereinafter, anexample of a configuration of the electronic device with the at leastone device will now be explained with reference to FIG. 4.

FIG. 4 is a perspective view illustrating an electronic device inaccordance with an exemplary embodiment of the present invention. Inparticular, although FIG. 4 shows a portable terminal as one particularexample of the electronic device capable of using a user interaction,the electronic device of the present is not limited to the portableterminal. Namely, as described above, various small devices and middleand big sized devices can be used, including thin client devices andlarge displays.

Referring now to FIG. 4, the electronic device of the present inventionmay include at least one device. For example, the electronic device mayinclude a first sensing device 410, a second sensing device 430, and athird sensing device 450. In the present invention, the respectivesensing devices 410, 430, and 450 indicate a sensing unit forrecognizing at least one interaction corresponding to a user gestureinput from a specific space neighboring the electronic device.

In an exemplary embodiment of the present invention, the respectivesensing devices 410, 430, and 450 include all types of recognition meanstracking the user gesture and generating a result value accordingthereto. For example, each of the sensing devices 410, 430, and 450 mayinclude recognition capability such as, for example, a proximity sensor,an infrared sensor, an illumination sensor, a heat sensor, or a camerasensor. In the case shown in FIG. 4, the electronic device is describedby way of example only that the first sensing device 410 and the secondsensing device 430 are a camera sensor, and the third sensing device 450is a proximity sensor. Namely, the electronic device of FIG. 4 indicatesa portable terminal including devices composed of two camera sensors 410and 430, and one proximity sensor 450.

Here, the locations of the sensing devices 410, 430, and 450 are notlimited to their respective locations shown in FIG. 4. For example, FIG.4 shows a case in which the first sensing device 410 and the secondsensing device 430 being a camera sensor are provided at left and rightsides of the electronic devices, and the third sensing device 450 beinga proximity sensor is provided inside the electronic device. However,the first sensing device 410, the second sensing device 430, and thethird sensing device 450 can be configured in various manners uponmanufacturing the electronic device in such a way that the first sensingdevice 410 and the second sensing device 430 are respectively providedat upper and lower sides of the electronic device, and the third sensingdevice 450 is disposed adjacent to one or both of the first sensingdevice 410 and the second sensing device 430.

Further, although the electronic device includes a plurality ofdifferent devices in a case of FIG. 4, the presently claimed inventionis not limited thereto. Namely, the electronic device of the presentinvention may be composed of one device. Moreover, the electronic deviceof the present invention can be configured by the same type of pluraldevices such as the first sensing device 410 and the second sensingdevice 430. In the meantime, the electronic device of the presentinvention can be composed of a combination of different types of devicessuch as the first sensing device 410, the second sensing device 430, andthe third sensing device 450. Structures of such devices can bevariously provided according to a form of the electronic device.

For example, the electronic device may constitute a device by onerecognition unit such as, for example a proximity sensor, an infraredsensor, an illumination sensor, by a combination of one proximity andone camera sensor, or a combination of one proximity and plural camerasensors.

Hereinafter, as shown in FIG. 4, operation of exemplary embodiments ofthe present invention will be explained with reference to a portableterminal that includes camera sensors provided at left and right sidesof the electronic device and one proximity sensor provided inside theelectronic device.

Namely, as shown in FIG. 4, a user gesture (e.g., hand shape, handgesture, and moving direction of a hand) occurring around the perimeterof the electronic device is recognized using the first sensing device410 and the second sensing device 430 being a camera sensor, and thethird sensing device 450 being a proximity sensor. Further, a usergesture recognized by at least one device is processed as an inputinteraction for controlling the electronic device.

At this time, in an exemplary embodiment of the present invention, thethird sensing device 450 being a proximity sensor checks whether or nota user gesture occurring in a space neighboring the electronic device isin close proximity (proximate state) to the electronic device andprovides a reference thereof. Furthermore, the third sensing device 450is used to check proximate recognition of a human body part (e.g.,user's hand, etc.) and to discriminate a region in a space neighboringthe electronic device by a predetermined distance. Namely, the thirdsensing device 450 senses whether or not an object is proximate to aspecific distance from the electronic device. In the present invention,the third sensing device 450 senses proximity of a user' hand todiscriminate a corresponding function of the electronic device. Namely,the third sensing device 450 generates a control signal for a spaceinteraction according to a user gesture operating in a space neighboringthe electronic device.

Further, in an exemplary embodiment of the present invention, the firstsensing device 410 and the second sensing device 430 correspond to acamera sensor and sense a user gesture to measure a moving direction, amoving speed, and a gesture shape (hand shape, etc.) of the usergesture. In particular, the first sensing device 410 and the secondsensing device 430 control a control signal for a plane interactionaccording to a user gesture operating in a space neighboring theelectronic device.

At this time, in the presently claimed invention, when the spaceinteraction and the plane interaction occur simultaneously according toa user gesture in the first sensing device 410, the second sensingdevice 430, and the third sensing device 450, the space interaction andthe plane interaction are defined as a convergence interaction, whichmay describe the generation of a control signal according to theconvergence interaction. Namely, in an exemplary embodiment of thepresent invention, in a status where a specific user gesture is sensedin one of the first sensing device 410 and the second sensing device430, when a user gesture is sensed in the third device 450, interactionsaccording the user gesture are classified by steps, namely, proximatelevels to control a corresponding function of the electronic device bythe third sensing device 450.

For example, upon recognition of the space interaction by a proximitysensor, the electronic device may control performance of a correspondingfunction mapped by a user gesture of the space interaction. Uponrecognizing the plane interaction by a camera sensor, the electronicdevice may perform a corresponding function mapped by a user gesture ofthe plane interaction. Upon recognizing a convergence interaction by thecamera sensor and the proximity sensor, the electronic device maycontrol performance of a corresponding function mapped by a user gestureof the convergence interaction. Such examples will be described withreference to drawings and a table according to respective exemplaryembodiments.

As described herein above, an overall exemplary arrangement for anoperation of the present invention can be configured by a device suchas, for example, a proximity sensor, a camera sensor, an infraredsensor, or an illumination sensor for sensing an interaction accordingto a user gesture; an electronic device including the device; and aprocessing unit (e.g., control unit or execution applicationcorresponding to each function) processing a function control by usinginteractions sensed from at least one device as an input. Here, thecontrol unit serves to control the electronic device using aninteraction according to an embodiment of the present invention. Theexecution application includes musical instrument play applications,image view applications, and camera function relation applications to bedescribed herein below. Such applications execute an operation definedaccording to an interaction provided from at least one device.

FIG. 5 is a schematic view illustrating recognition areas recognizingplane and space interactions in an electronic device in accordance withan exemplary embodiment of the present invention.

First, a gesture such as a user' hand gesture is sensed by at least onesensing device (410, 430, 450) included in the electronic deviceaccording to an exemplary embodiment of the present invention, and thesense gesture is discriminated according to a preset definition to beused as a meaningful input of the electronic device. At this time, in anexemplary embodiment of the present invention, at least one device isused to sense and discriminate the gesture, and the discriminated inputis defined for use with control interaction of the electronic device.

Referring now to FIG. 5, a recognition area for interaction recognitionin at least one device defined in the present invention can be dividedinto plane recognition areas 510 and 530 that the first sensing device410 and the second sensing device 430 recognize as the planeinteraction, and a space recognition area 550 that the third device 450recognizes as the space interaction.

In an exemplary embodiment of the present invention, the planerecognition areas 510 and 530 indicate areas that the first sensingdevice 410 and the second sensing device 430 sense a user's planeinteraction from a space neighboring the electronic device. The spacerecognition area 550 indicates an area in which the third sensing device450 senses a user's space interaction from a space neighboring theelectronic device. In this case, as shown in FIGS. 4 and 5, the planerecognition areas 510 and 530 can be respectively divided into left andright areas according to respective positions of the first sensingdevice 410 and the second sensing device 430 in the electronic device,and be disposed to recognize respective gestures according to a user'sleft and right hands.

At this time, in an exemplary embodiment of the present invention, auser gesture may be recognized in a recognition area of at least one ofthe first sensing device 410 to the third sensing device 450 todiscriminate an interaction with respect to the user gesture.Furthermore, the electronic device can be controlled according to thediscriminated interaction.

For example, assuming that a user plays a musical instrument using theelectronic device, the user can create an interaction by a gesture inputset in the recognition areas 510. Accordingly, the first sensing device410 and/or the second sensing device 430 recognize a user gesture in theplane recognition area 510 and/or the plane recognition area 530 togenerate a plane interaction with respect thereto, thereby processing acorresponding function according to the musical instrument play.Meanwhile, the third sensing device 450 recognizes a gesture entering adownward direction of a limit point (boundary line) of the spacerecognition area 550 based on the limit point thereof to generate aspace interaction striking a musical instrument, thereby processing acorresponding function according to playing the musical instrument.Moreover, a user gesture is recognized in a plane recognition area ofthe first sensing device 410 and/or the second sensing device 430 and ina space recognition area of the third sensing device 450 to generate aconvergence interaction with respect thereto, thereby processing acorresponding function according to playing a musical instrument.

As illustrated previously, in an exemplary embodiment of the presentinvention, the electronic device can be separately controlled accordingto interactions provided by at least one device. This separate controlaccording to interactions can be summarized as listed in following Table1.

TABLE 1 1st 2^(nd) 3^(rd) device device device Interaction Function √Plane Execute function defined in gesture measured in plane recognitionarea √ Plane Execute function defined in gesture measured in planerecognition area √ Space Execute function defined in gesture measured inspace recognition area √ √ Combination Execute function defined ingesture measured in plane recognition and space areas √ √ CombinationExecute function defined in gesture measured in plane recognition andspace areas √ √ √ Combination Execute function defined in gesturemeasured in plane recognition and space areas

As illustrated in Table 1, when an interaction is sensed in only a planerecognition area 510 of the first device 410, namely, in the planerecognition area 510 among outer sides of the space recognition area 550of the third device 450 (e.g., upper end of a limit point), a controlunit of the electronic device analyzes a user gesture measured in theplane recognition area 510 to control the electronic device according toa function defined previously in a corresponding gesture.

In the meantime, when an interaction is sensed in only a planerecognition area 530 of the second device 430, namely, in the planerecognition area 530 among outer sides of the space recognition area 550of the third device 450 (e.g., upper end of the limit point), thecontrol unit of the electronic device analyzes a user gesture measuredin the plane recognition area 530 to control the electronic deviceaccording to a function defined previously in a corresponding gesture.

Furthermore, when an interaction is sensed in only a space recognitionarea 550 of the third device 450, namely, in areas except for the planerecognition areas 510 and 530 among inner sides of the space recognitionarea 550 of the third sensing device 450 (e.g., lower end of the limitpoint), the control unit of the electronic device analyzes a usergesture measured in the space recognition area 550 to control theelectronic device according to a function defined previously in acorresponding gesture.

Additionally, when an interaction is sensed in a plane recognition area510 of the first sensing device 410 and a space recognition area 550 ofthe third sensing device 450, namely, in an area overlapping with theplane recognition area 510 among inner sides of the space recognitionarea 550 of the third sensing device 450 (e.g., lower end of the limitpoint), the control unit of the electronic device analyzes a usergesture measured in an overlapped area between the space recognitionarea 550 and the plane recognition area 510 to control the electronicdevice according to a function defined previously in a correspondinggesture.

Moreover, when an interaction is sensed in a plane recognition area 530of the second sensing device 430 and a space recognition area 550 of thethird sensing device 450, namely, in an area overlapping with the planerecognition area 530 among inner sides of the space recognition area 550of the third sensing device 450 (e.g., lower end of the limit point),the control unit of the electronic device analyzes a user gesturemeasured in an overlapped area between the space recognition area 550and the plane recognition area 530 to control the electronic deviceaccording to a function defined previously in a corresponding gesture.

In addition, when an interaction is sensed in the plane recognitionareas 510 and 530 of the first sensing device 410 and a spacerecognition area 550 of the third sensing device 450, namely, inrespective areas overlapping with the plane recognition area 530 amonginner sides of the space recognition area 550 of the third sensingdevice 450 (e.g., lower end of the limit point), the control unit of theelectronic device analyzes a user gesture measured in an overlapped areabetween the space recognition area 550 and the plane recognition area510 to control the electronic device according to a function definedpreviously in a corresponding gesture.

Meanwhile, as mentioned previously, an exemplary embodiment of thepresent invention classifies interactions into a plane interaction, aspace interaction, and a convergence interaction, and controls acorresponding function according to a measured user gesture andinformation defined with respect to a corresponding gesture. Asillustrated previously, an exemplary embodiment of the present inventiondivides use of a space using a recognition area of at least one devicethat enables interactions with respect to two or more levels.

The following is a detailed exemplary embodiment of the presentinvention with reference to FIGS. 6 to 8.

FIGS. 6 to 8 are schematic view illustrating an operating method of anelectronic device in respective recognition areas according to a usergesture in accordance with an exemplary embodiment of the presentinvention.

Referring now to FIG. 6, which illustrates a case where a user gestureis sensed outside a space recognition area 550, namely, in anon-overlapped area of the third sensing device 450 by the first sensingdevice 410 and/or the second device 430, and an operation thereof. Thatis, a user can create a previously defined gesture in a non-overlappedarea with the space recognition area 550 from among at least one planerecognition area of the first sensing device 410 and the second sensingdevice 430. Here, the gesture includes a hand's movement correspondingto up, down, left and right directions based on the electronic device,hand's various shapes, and hand's various gestures. Accordingly, acontrol unit of the electronic device analyzes a gesture according to aninteraction recognized by the first device 410 and/or the second sensingdevice 430 to control a corresponding mapped function.

Referring now to FIG. 7, which illustrates a case where a user gestureis sensed inside a space recognition area 550, namely, in an overlappedarea of the third sensing device 450 by the first sensing device 410and/or the second sensing device 430, and an operation thereof. In otherwords, a user can create a previously defined gesture in an overlappedarea with the space recognition area 550 from among at least one planerecognition area of the first sensing device 410 and the second sensingdevice 430. Here, the gesture includes a hand's movement correspondingto up, down, left and right directions based on the electronic device,hand's various shapes, and hand's various gestures. Accordingly, acontrol unit of the electronic device analyzes a gesture according to aninteraction recognized by the first sensing device 410 and/or the secondsensing device 430 and the third device sensing 450 to control acorresponding mapped function.

FIG. 8 illustrates a case where a gesture with a recognition areachanged to an overlapped area that is sensed across a space recognitionarea 550, namely, in a non-overlapped area of the third sensing device450, and an operation thereof. More particularly, a user can produce apreviously defined gesture in which an interaction enters an overlappedarea in a non-overlapped area with the space recognition area 550 fromamong at least one plane recognition area of the first device sensing410 and the second sensing device 430. Here, the gesture includes ahand's movement (e.g., a striking operation) that enters from an upperside to a lower side based on a limit point of the space recognitionarea 550. Accordingly, the control unit of the electronic device sensesan interaction moved to an overlapped area with a recognition area ofthe third sensing device 450 in recognition areas of the first sensingdevice 410 and/or the second sensing device 430, and analyzes a gestureaccording to the interactions, thereby controlling a correspondingmapped function.

An example of execution of a musical instrument playing function willnow be described based on the operation of FIG. 8. Striking a musicalinstrument can be controlled by passing a user interaction from anoutside of a limit point of the space recognition area 550 to an insidethereof. At this time, each of the first sensing device 410 and thesecond sensing device 430 may sense a change of a frame according toentering of a user gesture to recognize striking strength according to achanged size of the frame. Further, a frame change of the first sensingdevice 410 and/or the second sensing device 430 is analyzed with respectto a gesture entering from an outside of a limit point of the spacerecognition area 550 to an inside thereof such that it can be checkedwhether or not a percussion instrument is struck strongly or weakly.Such an operation is equally applied to left and right sides and can becontrolled to be used as different sound inputs. An exemplary embodimentof such an operation will now be described with reference to thefollowing drawings.

FIG. 9 is a flowchart providing an exemplary illustration of anoperation of a method for controlling an electronic device using a userinteraction in an electronic device in accordance with an exemplaryembodiment of the present invention.

Referring now to FIG. 9, at step (901) a control unit of an electronicdevice activates a mode for controlling an electronic device using auser interaction in response to a user's request. Here, for example, themode can be adaptively activated/deactivated according to a user'request, or may be always in an activated state according to the user'srequest. Accordingly, the mode activation procedure can be omitted fromthe present invention.

Next, at step (903) the control unit of the electronic device senses aninteraction from a space neighboring the electronic device. At thistime, as illustrated in the forgoing description with reference to FIGS.4 to 8, the control unit of the electronic device may receive at leastone interaction sensed through at least one device.

Subsequently, at step (905) the control unit of the electronic devicediscriminates an input interaction. Namely, the control unit of theelectronic device checks a recognition area of an interaction recognizedthrough the at least one device. In addition, the control unit checkswhether or not the interaction is recognized in a separate recognitionarea of at least one device or in an overlapped recognition area in atleast two devices. Furthermore, the control unit may discriminate a usergesture measured in a corresponding recognition area in which theinteraction is recognized.

Next, at step (907) the control unit of the electronic device checks aset function according to the input interaction. More particularly, thecontrol unit checks a function previously defined in a discriminateduser gesture according to the input interaction. Further, at step (909)the control unit of the electronic device controls the checked function.

FIG. 10 is a flow diagram illustrating an overall operation controllingan electronic device according to a user interaction in accordance withan exemplary embodiment of the present invention.

Referring now to FIG. 10, at (1010), when a user gesture occurs in aspace neighboring the electronic device, a control unit of theelectronic device may sense an interaction according to the user gesturefrom at least one device. Next at 1020, when the interaction is sensedfrom the at least one device, the control unit of the electronic deviceprocesses a procedure of discriminating the interaction of 1010.

In this particular case, the interaction has various forms according toa structure of the electronic device. For example, when the electronicdevice is configured of only a device such as, for example, a proximitysensor recognizing an interaction in a space, only a space interactionis sensed by the device. Further, when the electronic device isconfigured of only a device such as, for example, a camera sensorrecognizing an interaction on a plane, only a plane interaction issensed by the device. Meanwhile, when the electronic device isconfigured by different types of plural devices such as the proximitysensor and the camera sensor capable of separately recognizing theinteraction in the space and the interaction on the plane, at least oneof the space interaction and the plane interaction is sensed by thedevices.

In the meantime, at (1031) when it is discriminated that the interactionis the plane interaction, as mentioned in the description with referenceto FIGS. 4 to 9, at (1033) the control unit of the electronic devicecontrols performance of a function according to the plane interaction.In this particular example, the control unit of the electronic devicecan control performance of a corresponding function by types of theplane interaction. For example, the control unit tracks an interactionset corresponding to each user gesture (hand gesture, hand shape, movingdirection, etc.) occurring in a recognition area of the camera sensor,and controls a corresponding function according to the trackedinteraction.

With continued reference to FIG. 10, when at (1041) it is discriminatedthat the interaction is the space interaction, as mentioned in thedescription with reference to FIGS. 4 to 9, the control unit of theelectronic device at (1043) controls performance of a function accordingto the space interaction. In this particular example, the control unitof the electronic device can control performance of a correspondingfunction by the types of the space interaction. For example, the controlunit tracks an interaction set corresponding to each user gesture (handgesture, degree of proximity, etc.) occurring in a recognition area ofthe proximity sensor, and controls performance of a correspondingfunction according to the tracked interaction.

Next, when at (1051) it is discriminated (from 1020) that theinteraction is a convergence interaction (combination), as illustratedin the description with reference to FIGS. 4 to 9, at (1053) the controlunit of the electronic device controls performance of a functionaccording to the convergence interaction. Here, the convergenceinteraction is an interaction when the space interaction and the planeinteraction occur simultaneously. Namely, a user gesture occurring at anoverlapped area between a recognition area in which the spaceinteraction is sensed, and a recognition area in which the planeinteraction is sensed, can be sensed as a combination. This combinationis processed as the convergence interaction. At this time, the controlunit of the electronic device can control performance of a correspondingfunction by types of the convergence interactions. For example, thecontrol unit tracks an interaction set corresponding to respective usergestures (hand gesture, degree of proximity, hand shape, movingdirection, etc.) occurring in the overlapped area between therecognition areas of the proximity sensor and the camera sensor, andcontrols a corresponding function according to the interaction.

Meanwhile, when at (1060) a change of the corresponding interaction issensed during controlling the function according to the planeinteraction, the space interaction, and the convergence interaction,namely, when a recognition area or a gesture pattern in which the usergesture is sensed is changed, the control unit of the electronic devicemay return to step 1020 and perform the foregoing procedures.

Hereinafter, exemplary embodiments of an operation of the presentinvention and examples of a screen will be described. However, becausethe exemplary embodiments of the present invention are not limited tothe following descriptions, it will be recognized that the presentclaims may have various substitutions based that fall within the spiritof the invention and the scope of the appended claims.

FIGS. 11 to 14 are views illustrating exemplary embodiments of anoperation processing a function corresponding to a user interaction inan electronic device in accordance with an exemplary embodiment of thepresent invention. Here, a following exemplary embodiment is describedin that the first device 410 and the second device 430 are camerasensors, and the third device 450 is a proximity sensor.

Referring now to FIGS. 11 to 14, which show examples of an operationcontrolling performance of a corresponding function set to discriminatean interaction according to a proximate level sensed by a proximitysensor, upon executing a photo album application according to anexemplary embodiment of the present invention. Namely, FIGS. 11 to 14discriminate an interaction according to a user gesture occurring insideor outside a boundary (i.e. “limit point”) of the proximity sensor, andcontrol performance of a corresponding function. Hereinafter, a methodfor discriminating the interaction according to a proximate level andcontrolling various functions thereby will be explained with referenceto FIGS. 11 to 14.

First, FIG. 11 illustrates a particular example in which a functiondefined in a user gesture (e.g., hand's left/right motions) is anavigation function when an interaction occurs inside a recognition areaof the proximity sensor where optional objects (e.g., images) arepresented according to the execution of a photo album application.

With continued reference to FIG. 11, the control unit of the electronicdevice may recognize a user gesture input from an inside of therecognition area of the proximity sensor, and the user gesture to bemoved in one of up, down, left, and right directions in the recognitionarea of a camera sensor. Accordingly, the control unit combines theinteraction from the proximity sensor and the interaction from thecamera sensor to determine that the gesture is a convergenceinteraction. Moreover, the control unit performs a previously definedfunction in the convergence interaction according to a moving directionof the user gesture, namely, a gesture to be tracked. That is, thecontrol unit processes a navigation function with respect to an objectpresented corresponding to a moving direction of the gesture.

As described previously, when the convergence interaction occurs by theproximity sensor and the camera sensor, namely, when a gesture is alsosensed by the camera sensor in a state that a gesture is sensed by theproximity sensor, the control unit of the electronic device controlsperformance of a function executing a navigation between objectsaccording to a gesture sensed by the camera sensor during theconvergence interaction.

Next, referring to FIG. 12, which illustrates a case that a functiondefined in a user gesture (e.g., up and down motions of a hand) isextending/shortening functions when an interaction occurs inside therecognition area of the proximity sensor, wherein optional objects(e.g., images) are presented according to the execution of a photo albumapplication.

In FIG. 12, the control unit of the electronic device may recognize auser gesture input from an inside of the recognition area of theproximity sensor, and recognize a change of the user gesture, whichapproaches or moves away from the electronic device inside therecognition area of the proximity sensor. Accordingly, the control unitdetermines that the gesture is a space interaction according to a changeof a proximate level by the proximity sensor. Next, the control unitperforms a previously defined function in the space interactionaccording to a proximate level of the user gesture, namely, a gesture tobe tracked. In addition, the control unit processes extending/shorteningfunctions with respect to objects presented corresponding to the degreeof proximity of the gesture to the electronic device. At this time, whenthe gesture is separated from a recognition area (limit point) of theproximity sensor, the control unit may perform an operation restoringthe objects to a set basic size according to a set manner.

As illustrated previously, when a gesture is sensed by the proximitysensor or a gesture is also sensed by the camera sensor in a status inwhich the gesture is sensed by the proximity sensor, the control unit ofthe electronic device controls performance of a functionextending/shortening the objects according to the gesture sensed by theproximity sensor.

Subsequently, referring now to FIG. 13 shows a case that a functiondefined in a user gesture (e.g., up and down motions of a hand) that isa category navigation function when an interaction occurs outside therecognition area of the proximity sensor where optional objects (e.g.,images) are presented according to the execution of a photo albumapplication. As shown in FIG. 13, an interaction with respect to a usergesture input from an outside of the recognition area of the proximitysensor does not occur by the proximity sensor. Namely, the user gestureis sensed at only the recognition area of the camera sensor to generatean interaction according thereto. In this case, when the control unit ofthe electronic device recognizes a gesture moving in one of up, down,left, and right directions in the recognition area of the camera sensor,it determines the interaction by the camera sensor is a planeinteraction, and controls a function (e.g., category navigationfunction) mapped in a moving direction of the user gesture, namely, agesture to be tracked. In particular, the control unit processes anavigation function with respect to categories presented correspondingto the moving direction of the gesture.

Accordingly, when the plane interaction occurs by the camera sensor, thecontrol unit controls a function executing navigation between categoriesaccording to the plane interaction. At this time, content (e.g., images)included in a corresponding category may be simultaneously changed to beprovided according to a change of the category.

Then, referring to FIG. 14, which shows a case where a function definedin a user gesture (e.g., rotation of a hand) is an object rotatingfunction, when an interaction occurs outside the recognition area of theproximity sensor where optional objects (e.g., images) are presentedaccording to execution of an album application.

FIG. 14 shows an interaction with respect to a user gesture input froman outside of the recognition area of the proximity sensor does notoccur by the proximity sensor. For example, the user gesture is sensedin only the recognition area of the camera sensor to generate acorresponding interaction. In this particular case, when the controlunit of the electronic device recognizes a gesture rotating clockwise orcounterclockwise in the recognition area of the camera sensor, itdetermines the interaction by the camera sensor is a plane interaction,and controls a function (e.g., object rotation function) mapped in amoving direction of the user gesture, namely, a gesture to be tracked.Namely, the control unit processes a rotation function with respect toobjects presented corresponding to the rotating direction of thegesture.

Accordingly, when the plane interaction occurs by the camera sensor, thecontrol unit controls a function rotating objects according to the planeinteraction. At this time, the control unit can adaptively reflect andprovide an effect rotating the object to a corresponding directionaccording to clockwise or counterclockwise rotation of the gesture.

As illustrated above, in an exemplary embodiment of the presentinvention, an area in a space according to an approaching can bedetermined using the proximity sensor. Further, various operations arepossible according to a user's definition in such a way that a movingdirection of the gesture is recognized inside a proximate area by acamera sensor to be used as a corresponding interaction and gestureshape/operation is recognized outside the proximity sensor by the camerasensor to be used as a corresponding interaction.

FIGS. 15 and 16 are views illustrating another exemplary embodiment ofan operation processing a function corresponding to a user interactionin an electronic device in accordance with an exemplary embodiment ofthe present invention. In this particular case, the following will bedescribed that the first device 410 and the second device 430 comprisecamera sensors, the third device 450 comprises a proximity sensor, thecamera sensor being the first device 410 that performs a fundamentalfunction of a camera, and the camera sensor being the second device 430that operates as a function for a user interaction in the presentinvention. Further, the functions of the first device 410 and the seconddevice 430 can be used to exchange with each other.

FIGS. 15 and 16 show cases of an operation controlling a function fordiscriminating an interaction according to a proximate level sensed bythe proximity sensor. In particular, FIGS. 15 and 16 show operations ofthe electronic device in cases of executing a self photographingfunction among functions using a camera. The operations of FIGS. 15 and16 would also be equally applicable to the time of a video call.

FIGS. 15 and 16 illustrate examples of operations that discriminate aninteraction according to a user gesture occurring inside or outside arecognition area (i.e. “limit point”) of a proximity sensor, and controla function related to a self photographing according to a user gesturecorresponding to each interaction, respectively. FIGS. 15 and 16 alsoindicate examples of operations that discriminate an interaction sensedby a proximity sensor and remaining other camera sensors upon executionof a self-photographing application and control a set self photographingfunction, respectively.

First, FIG. 15 illustrates a case that an interaction according to auser gesture occurs inside a recognition area 550 of the proximitysensor during execution of the self-photographing function. As shown inFIG. 15, the control unit of the electronic device may recognize a usergesture input from an inside of the recognition area 550 of theproximity sensor, and recognize the user gesture to be changed, namely,the user gesture to be proximate or spaced to or from the electronicdevice inside the recognition area 550 of the proximity sensor.Accordingly, the control unit determines that the gesture is aninteraction according to a change in a proximate level by the proximitysensor. Further, the control unit performs a previous defined functionin the interaction according to a proximity level of the user gesture,namely, a gesture to be tracked. For example, the control unit processeszoom-in/zoom-out functions of a subject according to self photographingcorresponding to degree of proximity of the gesture to the electronicdevice.

As illustrated above, when a gesture is sensed by the proximity sensoror a gesture is also sensed by the camera sensor in a state that thegesture is sensed by the proximity sensor, the control unit of theelectronic device controls zoom-in/zoom-out functions according toself-photographing according to the gesture sensed by the proximitysensor.

FIG. 15 shows that when a user interaction occurs by the camera sensorand the user interaction occurs by the proximity sensor, or the userinteraction occurs by only the proximity sensor, the control unit cancontrol zoom-in/zoom-out functions of the self-photographing accordingto a proximate level of the user interaction by the proximity sensor. Atthis time, the control unit processes the zoom-in/zoom-out functionsaccording to a proximate level occurring inside the recognition area ofthe proximity sensor namely, a recognition rate. As shown in FIG. 15,when a user' hand is proximate to a direction of the electronic devicefrom a limit point of the recognition area 550 of the proximity sensor,the control unit may process the zoom-in function. Conversely, when theuser's hand is spaced apart from the limit point of the recognition area550 of the proximity sensor in the electronic device, the control unitmay process the zoom-in function.

Then, FIG. 16 shows a case where an interaction according to a usergesture occurs outside the recognition area 550 of the proximity sensorduring the execution of a self photographing function. As shown in FIG.16, the user gesture is sensed in only the recognition area 550 of thecamera sensor to generate a corresponding interaction. In this case,when the control unit of the electronic device recognizes a gestureoccurring in a recognition area 550 of the camera sensor, it performs afunction mapped according to a form of the user gesture, namely, agesture to be tracked in the interaction by the camera sensor. Forexample, when the gesture has a hand shape corresponding to “OK”, thecontrol unit processes a photograph function according to a selfphotograph corresponding to the hand shape.

In FIG. 16, when a user gesture occurs by the camera sensor, the controlunit may process various additional functions according to aself-photograph corresponding to a form of a gesture tracked by thecamera sensor.

Meanwhile, a function control between the camera sensor and theproximity sensor in the self-photograph and the like is not alwayslimited to the foregoing exemplary embodiments. For example, functioncontrol information between a user gesture and a device may depend on auser's set. The exemplary embodiment may be as illustrated in Table 2.

TABLE 2 Proximity Camera Sensor Sensor Interaction Function √ √ Forwardand back Zoom-in/out movements in recognition area √ √ Forward and backZoom-in/out movements in recognition area √ Left and right Zoom-in/outmovements √ Hand shape Change photograph mode √ √ Hand shape Changephotograph mode √ √ (Reverse) Circle Change rotation horizontal/vertical√ (Reverse) Circle Change rotation horizontal/vertical . . . . . . . . .. . .

As illustrated in Table 2, in an exemplary embodiment of the presentinvention, a user can set interactions, gestures, and functionscorresponding thereto.

For example, with respect to the same zoom-in/zoom-out functions, aconvergence interaction is sensed by the proximity sensor and the camerasensor, a plane interaction or a space interaction is sensed by any onedevice, and a gesture for generating an interaction may be set by auser's request. Furthermore, a gesture for generating an interaction canbe set whether the same gesture and a function according thereto areperformed by a space interaction or a plane interaction according to auser's convenience.

FIGS. 17 to 20 are views illustrating further exemplary embodiments ofan operation processing a function corresponding to a user interactionin an electronic device in accordance with an exemplary embodiment ofthe present invention. At this time, the following has been describedthat the first device 410 and the second device 430 comprise camerasensors, and the third device 450 comprises a proximity sensor.

In this case, each of electronic devices shown in FIGS. 17 to 20 is adevice discriminating a user interaction, and includes two cameras at aplane side thereof and a proximity sensor inside or at one side thereof.Such an arrangement is an example of various electronic devices. Anelectronic device according to the presently claimed invention is notlimited to a structure shown in each of FIGS. 17 to 20.

First, now referring to FIG. 17, an example of an operation that a userinput a gesture during the execution of a musical instrument playapplication in an electric device. As shown in FIG. 17, a user's leftand right hands can be located at respective recognition areas of thetwo camera sensors 410 and 430. At this time, each of the two cameras410 and 430 continues to sense left and right gestures, respectively.

Further, a recognition area (i.e. “limit point”) of the proximity sensor450 is regarded as a virtual surface of a percussion instrument, and itcan be defined that the percussion instrument is struck when an inputentering from an outside of the recognition area (limit point) to aninside thereof is sensed. Moreover, each of the camera sensors 410 and430 may sense a moving speed of a user gesture, which can be defined asan intensity of force playing a musical instrument.

As an example, as shown in FIG. 17, assuming that a musical instrumentplay application is executed in the electronic device, two camerasensors 410 and 430, and a proximity sensor 450 are used to play amusical instrument through gestures of left and right hands. Further,the speed of a hand gesture can be measured by tracking a frame changesensed in the two camera sensors 410 and 430.

Meanwhile, although a case of using two camera sensors 410 and 430 isillustrated in FIG. 17, a plurality of camera sensors greater than 2 maybe provided. When respective recognition areas are discriminated, thecamera sensors may receive a plurality of inputs.

Hereinafter, an operation executing a musical instrument play functionin an electronic device using a user interaction according to anexemplary embodiment of the present invention will be explained.

Referring to FIGS. 18 to 20, the electronic device may firstly display auser interface (UI) corresponding to a musical instrument playapplication on a screen. The UI may be a Graphical User Interface (GUI)corresponding to a form of a real musical instrument or a GUIsimplifying a form of the real musical instrument. FIGS. 18 to 20 showGUIs obtained by simplifying a form of a musical instrumentcorresponding to a user's request, respectively. For example, when auser selects a drum among percussion instruments, each of FIGS. 18 to 20shows a corresponding GUI of a drum.

As shown in FIG. 18, when a user strikes a musical instrument, theelectronic device recognizes only an operation of entering an inside ofa recognition area by a proximity sensor to process an interaction. Atthis time, each of the camera sensors 410 and 430 may sense a change ofa frame and process an interaction according to the change of the frame.Namely, a strength of movement according to the user gesture can bediscriminated. The camera sensors 410 and 430 analyze the change of theframe with respect to a motion of a gesture entering an inside of therecognition area of the proximity sensor 450 from an outside thereof andcheck whether or not a user strikes a percussion instrument strongly orweakly based on the analyzed result. Such an operation is equallyapplied to left and right directions, and can be respectively used asdifferent sound inputs.

Next, as shown in FIG. 19, a repeated weak input in playing a musicalinstrument is defined as a wave gesture inside the recognition area ofthe proximity sensor 450. When an interaction such as the wave gestureoccurs in an overlapped recognition area between the proximity sensorand the camera sensor, it can be processed as a continuous weak input inplaying the musical instrument.

Subsequently, referring to FIG. 20, the musical instrument may continuesounding because of characteristics thereof. Accordingly, an interactionmuting a current sound can be defined. In FIG. 20, an input controllinga mute function is defined as a wave gesture occurring outside therecognition area of the proximity sensor 450. When an interaction occursby the camera sensors 410 and 430 outside the recognition area of theproximity sensor 450, it can be processed as a mute input in a musicalinstrument play function. Such an operation can mute one or both of leftand right sides in which a user interaction occurs.

As described above, in an exemplary embodiment of the present invention,an electronic device according to a user interaction can be controlledusing at least one device. For example, a camera sensor may continue tosense a gesture of a user's hands and use a corresponding gesture aseach interaction. Further, a proximity sensor may define a proximatearea and uses it to discriminate a space area.

According to the present invention as described above, a combination oftwo sensors may preferably utilize a concept of a space (proximatelevel) to provide extended interactions in comparison with aninteraction manner using a single sensor.

As is seen from the forgoing description, in the method and device forcontrolling an electronic device using a user interaction according tothe present invention, the electronic device of the present inventionincludes at least one device recognizing at least one user interactionfrom a space neighboring the electronic device. A user can control theelectronic device simply and intuitively by only a user gesture set in aspace neighboring the electronic device. The present invention maydefine an execution function with respect to at least one userinteraction recognized by the at least one device according to a user'ssetting, and variously control the electronic device according to aninput user interaction.

Further, the present invention is not limited to a uniquely limitedinput unit and input manner to control the electronic device. Inaddition, the present invention can intuitively control the electronicdevice to give a sense of reality according to a user gesture usingdifferent types of plural devices. The present invention may recognize auser gesture operating in a space neighboring the electronic deviceusing different types of plural devices and control the electronicdevice by the interaction according to the user gesture. As a result,the control of the electronic device may improve a user's convenienceand accessibility.

In addition, in an exemplary embodiment of the present invention, uponexecuting a play function using the electronic device, a musicalinstrument may be played according to an interaction by a user gesturein a space neighboring the electronic device. Accordingly, musicalinstruments can be intuitively played to give a sense of reality suitedto features of various musical instrument objects (drums, guitars,trumpets, etc.). As mentioned above, the present invention may providevariety with respect to a user's electronic device control input in thatan electronic device is controlled in input manners other than key inputor touch input of a screen. As a result, in the present invention, auser can control the electronic device in various and complex mannersthrough various inputs. As described above, the present inventionimproves a uniquely limited control manner of the electronic device, andaccordingly it can provide enhanced reality and convenience to a userwhen the user uses the electronic device.

The above-described methods according to the present invention can berealized in hardware or as software or computer code that can be storedin a recording medium such as a CD ROM, an RAM, a floppy disk, a harddisk, or a magneto-optical disk or downloaded over a network, so thatthe methods described herein can be rendered in such software using ageneral purpose computer, or a special processor or in programmable ordedicated hardware, such as an ASIC or FPGA. As would be understood inthe art, the computer, the processor or the programmable hardwareinclude memory components, e.g., RAM, ROM, Flash, etc. that may store orreceive software or computer code that when accessed and executed by thecomputer, processor or hardware implement the processing methodsdescribed herein. In addition, it would be recognized that when ageneral purpose computer accesses code for implementing the processingshown herein, the execution of the code transforms the general purposecomputer into a special purpose computer for executing the processingshown herein.

Although exemplary embodiments of the present invention have beendescribed in detail hereinabove, it should be clearly understood thatmany variations and modifications of the basic inventive concepts hereindescribed, which may appear to those skilled in the art, will still fallwithin the spirit of the invention and the scope of the presentinvention as defined in the appended claims.

1. An electronic device using an input interaction, comprising: a devicerecognizing at least one interaction occurring in a predefined spaceneighboring the electronic device; and a control unit for controllingperformance of a function by the electronic device according to the atleast one interaction recognized by the device.
 2. The electronic deviceof claim 1, wherein the device includes: a first sensing devicerecognizing a plane interaction according to a user gesture occurring ona plane around the electronic device; and a second sensing devicerecognizing a space interaction according to a user gesture occurring ina space around the electronic device.
 3. The electronic device of claim2, wherein the first sensing device and the second sensing device have asame sensing type configuration or different sensing typeconfigurations.
 4. The electronic device of claim 2, wherein the deviceincludes a recognition area in which an interaction is recognizedaccording to a user gesture, and the recognition area is divided into aplurality of areas corresponding to a structure of the device, and anoverlapped region is formed between the divided areas.
 5. The electronicdevice of claim 4, wherein the device provides information correspondingto the plane and space interactions from the recognition area of theoverlapped region and information corresponding to a plane or spaceinteraction from a separate recognition area except for the overlappedregion.
 6. The electronic device of claim 5, wherein the control unitdiscriminates between one of a plane interaction and a space interactionaccording to the information, and controls the electronic device toperform a function corresponding to the discriminated interaction. 7.The electronic device of claim 6, wherein the control unit controls theelectronic device to perform a function corresponding to the planeinteraction and the space interaction when the plane interaction and thespace interaction occur simultaneously.
 8. An electronic device controlsystem, comprising: a first sensing device recognizing a planeinteraction according to a user gesture occurring on a plane around theelectronic device; a second sensing device recognizing a spaceinteraction according to a user gesture occurring in a space around theelectronic device; and a processing means for discriminating between aplane interaction or a space interaction, and for controlling theelectronic device to perform a function corresponding to thediscriminated interaction.
 9. The electronic device of claim 8, whereinthe first device and the second device are configured to have a sameconfiguration type or a different configuration type.
 10. The electronicdevice of claim 9, wherein the first sensing device includes arecognition area for the plane interaction, the second sensing devicehas a recognition area for the space interaction, and the recognitionareas of the first and second devices has an overlapped area.
 11. Theelectronic device of claim 10, wherein each of the first sensing deviceand the second sensing device provides interaction information accordingto a user gesture recognized in its recognition area to the processingmeans.
 12. The electronic device of claim 11, wherein the processingmeans controls the electronic device to perform a function correspondingto at least one interaction information from at least one of the firstsensing device and the second sensing device.
 13. A method forcontrolling an electronic device using an input interaction, comprising:recognizing at least one interaction occurring in a space neighboringthe electronic device; and controlling the electronic device to performa function corresponding to the at least one interaction.
 14. The methodof claim 13, wherein recognizing of at least one interaction comprises:sensing a user gesture from a space neighboring the electronic device;and recognizing at least one interaction to perform the functioncorresponding to the user gesture.
 15. The method of claim 14, furthercomprising: discriminating between the at least one recognizedinteraction; and controlling performance of a function corresponding tothe at least one discriminated interaction.
 16. The method of claim 14,wherein recognizing of at least one interaction comprises recognizingone of a plane interaction and a space interaction in the spaceneighboring the electronic device according to a recognition area of theuser gesture.
 17. The method of claim 16, wherein the recognition areais divided into a recognition area for the plane interaction and arecognition area for the space interaction, and the recognition areacomprises an overlapped region between the recognition area for theplane interaction and the recognition area for the space interaction.18. The method of claim 16, wherein controlling of the electronic devicecomprises discriminating between one of the plane interaction and thespace interaction, and controls the electronic device to perform acorresponding to the discriminated interaction.
 19. The method of claim16, wherein controlling of the electronic device to perform a functioncomprises controlling the electronic device corresponding to the planeinteraction and the space interaction when the plane interaction and thespace interaction simultaneously occur.
 20. The method of claim 16,further comprising: discriminating a type of user gesture uponrecognizing the interaction; and tracking a previously defined controlfunction corresponding to the user gesture.